Clock-Modeled Ternary Spatial Relations for Visual Scene Analysis
نویسنده
چکیده
The analysis and the description of complex visual scenes characterized by the presence of many objects of interests involve reasoning on spatial relations such as “above”, “below”,“before”, “after” and “between”. In this context, we have defined these semantic concepts in terms of ternary spatial relations and we have formalized them using the clock model which is based on the clock-face division and the semantic notions of hours to describe relative spatial positions. The presented approach has been efficiently applied for the automated understanding of spatial relations between multiple objects in real-world computer vision image datasets.
منابع مشابه
Scene Semantic Understanding Based on the Spatial Context Relations of Multiple Objects
As a result of the large semantic gap between the low-level features and the high-level semantics, scene understanding is a challenging task for high satellite resolution images. To achieve scene understanding, we need to know the contents of the scene. However, most of the existing scene classification methods, such as the bag-of-visual-words model (BoVW), feature coding, topic models, and neu...
متن کاملA Neural Network for Spatial Relations: Connecting Visual Scenes to Linguistic Descriptions
This paper presents a system based on neural networks that can analyse spatial relations in a visual scene and connect them to appropriate linguistic descriptions. The system learns spatial concepts like “right of” and “above” by viewing a visual scene containing a number of objects and simultaneously receiving a text string describing the scene. The spatial relations between the objects in the...
متن کاملThe Extraction of Trajectories from Real Texts Based on Linear Classification
Text-to-scene conversion systems need to share the spatial descriptions between natural language and the 3D scene. Such applications are the ideal candidates for the extraction of spatial relations from free texts, in which the extraction to trajectories that are focus objects in spatial descriptions is an essential problem. We present an analysis of how the space relations are described in Chi...
متن کاملSpatial Reasoning and Connectionist Inference
The system presented in this paper is based on ideas taken from Automated Reasoning and Connectionism. The connectionist inference system Chcl is applied to solve the question whether a given sentence correctly describes the spatial relations of objects shown in a visual scene. The sentence is posed in relational form to a set of rules deening spatial relations among objects and a set of facts ...
متن کاملExtracting Spatial Relations Among Objects for Failure Detection
A cognitive robot may face failures during the execution of its actions. These failures are mostly due to the gap between the physical world and the constructed symbolic plans, some internal problems that may occur in its embodiment or unexpected external events. In this paper, we propose a visual scene interpretation system for extracting spatial relations among objects in a scene and using th...
متن کامل